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The invention relates to image processing 
apparatus. 

In accordance with the present invention, imag 
processing apparatus comprises an input device 
including an indicator and a surface over which the 
indicator is moved; position determining means for 
determining the position of the indicator on the sur- 
face; a force monitor for monitoring the force with 
which the indicator is pressed onto the surface; a 
frame store for storing digital data defining the colour 
component content of an image; and processing 
means connected to the input device and the frame 
store for simulating an electronic paint brush carrying 
paint which is laid down in the frame store at locations . 
corresponding to the positions of the indicator on the 
surface and whose characteristics are determined at 
least In part in accordance wfth the force monitored by 

the force monitor. 

We have developed a new type of image proces- 
sing apparatus which enables many interesting and 
unusual effects to be achieved in which the character- 
istics of the paint carried by the paint brush are deter- 
mined at least in part by the force with which the 
indicator is pressed onto the surface. Examples of 
paint characteristics include hue, brightness and 
saturation. A particularly advantageous application 
involves modifying brightness and saturation while 
maintaining hue constant 

The invention is applicable to modifying images 
which have been scanned using a conventional elec- 
tronic scanner but is particularly applicable to images 
which are created electronically by use of the input 
device. The invention can be used to create an image 
in the frame store or to modify an existing image in 
which the new paint is combined with previous paint 
in a known manner. 

Preferably, the processing means applies to the 
monitored force value a colour selection function for 
each colour component, the colour selection function 
defining the variation in characteristic^) of the corre- 
sponding colour component with monitored force. 

Preferably, the colour selection function Is dis- 
continuous and defines colour component values for 
spaced groups of force values. Thus, in this case, 
there will be certain force values for which a colour 
component value of zero is obtained. 

Other forms of the colour selection function are 
also possible so that for example the function can 
define a straight or curved variation or be non-uniform 
and can vary either In a controlled manner or in a ran- 
dom manner, for example separate Gaussian varia- 
tions in each colour channel. That is each component 
could have a random offset added or subtracted from 
th current colour valu , the probability of any particu- 
lar offset being e.g. Gaussian. The pen pressure 
would be used to modulate th "width of the Gaussian 
curve, with hard pressure giving a higher probability 
of getting a given, large change from th "base" col- 



our. 

Where th imag is d fined by m re than ne col- 
our component, the associated colour selection func- 
tions are preferably different 
5 The processing means defines, in a conventional 
manner, the shape, size and density profile of the 
brush. 

Typically, the indicator comprises a pressure pen 
and the surface is defined by a digitising tablet Other 
10 forms of input device, however, are also possible. 

Preferably, the apparatusfurther comprises a dis- 
play connected to the frame store so as to display the 
Image defined by digital data in the frame store. 
The processing means may be provided by a suit- 
15 ably programmed computer or by hard wired circuits. 
An example of image processing apparatus 
according to the invention will now be described with 
reference to the accompanying drawings, in which:- 
Figure 1 is a block diagram of the apparatus; 
20 Figure 2 is a block diagram of the graphics image 

processor of Figure 1 ; 

Figures 3A-3D illustrate four different coiour 
selection functions; and, 
Figures 4A-4D illustrate four farther colour selec- 
25 tion functions. 

The apparatus shown in Figure 1 can be divided 
into two primary parts. These comprise the host 1 and 
the graphics sub-system 2. The division is shown in 
Figurel byadashed fine. The hostl is a 68020 micro- 
30 processor based system running UNIX which Is a mul- 
ti-tasking, multi-user operating system. The host 
comprises an I/O processor 3 coupled to a keyboard 
4, a digitizing tablet 5 and associated pen 31, a sys- 
tem disk 6 and other data sources (not shown). The 
35 I/O processor 3 is connected to a system inter-con- 
nect bus (SIB) 7 which Is connected to ROM and RAM 
memory 8, a CPU 9, and an interface adapter 10. The 
Interface adapter 10 is connected to a number of high 
speed image discs 11 which hold data defining the 
40 colour content of pixels of images at high resolution, 
the adapter also being connected via an interface 12 
with the graphics sub-system 2. As mentioned above, 
the host has a conventional form and will not be des- 
cribed In detail. However, the SIB 7 is described In 
45 more detaB in EP^A-0332417. 

The programme that runs on the host is a single 
"process" which reads and processes Inputs from the 
digitizing tablet 5 under operator control and directs 
the graphics part 2 to display the host's responses to 
50 those inputs on the graphics monitor 30. Essentially, 
the system takes advantage of the host system in 
being able to perform a majority of the calculations so 
that only a small amount of control data is passed to 
the graphics sub-system. This graphics part 2 is much 
55 better than th host 1 at creating and manipulating 
graphical obj cts but the host is better at controlling 
input/output to periph rals, discs and tapes and is 
relatively asy to programme. 
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The graphics sub-system 2 comprises an Inter- 
face 13 which connects the graphics part to the host 
1, the interface 13 being connected to a bus 14. The 
bus 14 is connected to five graphics image proces- 
sors (GIPs) 15-19. In this embodiment, it Is assumed 
that the images are defined by four colour compo- 
nents, namely cyan, magenta, yellow and black, there 
being a separate GIP for each colour. Thus, the GIP 
1 5 processes the cyan colour component, the GIP 16 
the magenta colour component, the GIP 17 the yellow 
colour component and the GIP 18 the black colour 
component If the image was represented by a diffe- 
rent number of colour components, for example red, 
green and blue then only three of the GIPs would be 
needed. The advantage of providing the GIPs 15-18 
in parallel is that each component of each pixel in the 
image can be processed in parallel so that the overall 
processing time is reduced by up to four times over 
the processing time with a single processor. A further 
advantage of using the GIPs is that each has a bit- 
slice processor on which the programmer can define 
instructions useful for a particular application. 

A fifth GIP 19 is provided for defining one or more 
masks and other features. 

The construction of one of the GIPs of Figure 1 is 
shown in Figure 2. Each GIP comprises a bit-slice pro- 
cessor 20 coupled to bulk memory 21. This memory 

21 will hold image data, brush profiles and text as 
required and is used as virtual image memory. 

The bit-slice processor 20 is also connected to a 
pair of firamestores 22, 23 each of which has dimen- 
sions 1280x1204 and is 8 bits deep. In the GIPs 15- 
1 8, each framestore will hold 8 bit colour data while in 
the mask GIP 19 each framestore can be used to hold 
8 bit masks or two separate 4 bit masks. Furthermore, 
one of the firamestores in the GIP 19 can be used to 
display menus in one four bit plane and overlays In the 
other four bit plane. Overlays comprise construction 
lines and boxes and the like which are to be displayed 
on the monitor. 

The eight bit data in each framestore 22, 23 is 
applied in four bit "nibbles" to respective scroll, 
amplify and zoom circufts 24-27 which operate in a 
conventional manner to perform one or more of the 
functions of scroll, zoom and amplify, the outputs from 
these circuits being fed to a mixer circuit 28. The cir- 
cuit 28 mixes the data from each of the firamestores 

22 associated with the GIPs 1 5-18 with the data from 
each of the frame stores 23 associated with the GIPs 
15-18 in accordance with the mask stored in the 
framestore 22 of the GIP 1 9. This mixer circuit which 
operates in two stages Is described in more detail in 
EP-A-0344976. 

The output from th mixer circuit 28 Is fed to a two 
stage colour converter 29 which converts th tour col- 
our component data to three colour component data 
.g. red, green and blu suitabl for controlling the 
display on a monitor screen 30. 



In use, images are stored on the high speed 
imag disks 11 and these Images may have been 
generated by scanning original transparencies or 
other representations or they may have been created 

5 electronically using an electronic paint brush. The 
host 1 causes relevant portions of these images to be 
"paged" in and out of the bulk memory 21 in the GIPs 
15-18 and brush profiles to be loaded and unloaded 
from the bulk memory 21 in the GIP 19. The Interface 

10 adaptor 10 has Its own 68020 processor to allow it 
Independently to control the disks 1 1 . The GIPs 1 5-1 8 
are directed by the host 1 to do various things to 
images in the bulk memory 21 so that when a GIP 
attempts to access an address in an image that is not 

1 s currently in its bulk memory then part of that memory 
is written back to disc and a new portion read In. After 
the GIPs have finished processing, the data in the 
framestores is then scrolled, zoomed and/or amplified 
as necessary, mixed in the circuit 28, converted to 

20 monitor format and then displayed* 

If the host 1 wishes to display menus on the 
screen, these are drawn into the mask GIP framestore 
23, known as the "overlay plane". 

The digitising tablet 5 not only indicates the cur- 

25 rent location of the pen 31 but also the pressure with 
which the pen is applied to the tablet This pressure 
is contained within a seven digit data field allowing 
128 possible pressure levels. The pressure value is 
taken by the host 1 and is used to address respective 

30 look-up tables in the memory 8. These look-up tables 
define the colour components of the colour to be used 
by the paint brush generated by the GIPs 15-18. 

Figures 3A-3D fllustrate by way of example four 
different colour selection functions which are 

35 associated with the cyan, magenta, yellow and black 
colour components respectively. Each look-up table 
has a set of addresses corresponding to all possible 
pressure values, typically 128, and in each address a 
density value is stored as defined by the appropriate 

40 function. It will be noted that in these examples each 
colour selection function is discontinuous (although 
this wOI not always be the case) and for each colour 
component there are certain pressure values which 
result in a zero density value. It wOI be noted, how- 

4$ ever, that the four functions are different 

Figures 4A-4D illustrate four further colour selec- 
tion functions. 

In operation, the operator or artist moves the 
pressure pen 31 across the tablet 5 and the host 1 

so monitors the applied pressure. The pressure signal Is 
sampled regularly and In response to each pressure 
sample the look-up tables are addressed and the 
appropriate colour component values accessed. 
These values are then used after modification by the 

55 density profile of the selected "brush", to lay down 
paint in the frame stores 23. The result is displayed on 
the monitor 30 after combination with any imag inth 
frame stores 22. 
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Th Invention can hav the effect of working with 
a multi-layer scraper board, given suitable I ok-up 
functions. Thatis, it gives the appearance that the har- 
der the applied pressure the more layers are scraped 
away to reveal a particular colour. If the brush has a 5 
curved density profile then the colours which have 
been scraped away would stffl remain visible at the 
edges of the brush so that the artist can soon learn to 
pass from a doodling mode in which colours flow 
rather like a ofl film on water, to a controlled artistic 
mode in which selected colours can be pushed In a 
chosen direction. 

In one application, the host 1 could respond to the 
detection of two different pressures at spaced posi- 
tions across the tablet 5 to generate automatically a 
linear vignette of colour varying between the colours 
defined by the two pressures. 



groups off rce values. 

6. Apparatus according to claim 4 or claim 5, whe- 
rein the Image is defined by more than one colour 
component, the associated colour selection func- 
tions being different 

7. Apparatus according to any of the preceding 
claims, further comprising a display (30) connec- 
ted to the frame store (22) so as to display the 
image defined by digital data in the frame store. 
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Claims 

1 . Image processing apparatus comprising an input 
device including an indicator (31) and a surface 
(5) over which the Indicator is moved; position 
determining means for determining the position of 25 
the indicator on the surface; a force monitor (3) for 
monitoring the force with which the indicator is 
pressed onto the surface; a frame store (22) for 
storing digital data defining the colour component 
content of an image; and processing means (3) 30 
connected to the input device and the frame store 

for simulating an electronic paint brush carrying 
paint which is laid down in the frame store at loca- 
tions corresponding to the positions of the Indi- 
cator on the surface and whose characteristics 35 
are determined at least in part in accordance with 
the force monitored by the force monitor. 

2. Apparatus according to daim 1, wherein the 
characteristics are chosen from hue, brightness 40 
and saturation. 

3. Apparatus according to claim 2, wherein the pro- 
cessing means is adapted to maintain hue con- 
stant while modifying brightness and saturation In 45 
accordance with the monitored force. 

4. Apparatus according to any of the preceding 
claims, wherein the processing means applies to 

the monitored force value a colour selection fUnc- so 
tion for each colour component, the colour selec- 
tion function defining the variation in 
characteristics) of the corresponding colour 
component with monitored force. 

55 

5. Apparatus according to claim 4, wh rein th col- 
our selection function is discontinuous and 
d fines colour component values for spaced 
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The Irrv ntlon can have the effect of working with 
a multi-layer scraper board, given suitable look-up 
functions. That Is, it gives th appearance that the har- 
der the applied pressure the more layers are scraped 
away to reveal a particular colour. If the brush has a 
curved density profile then the colours which have 
been scraped away would still remain visible at the 
edges of the brush so that the artist can soon learn to 
pass from a doodling mode in which colours flow 
rather like a oQ film on water, to a controlled artistic 
mode in which selected colours can be pushed in a 
chosen direction. 

In one application, the host 1 could respond to the 
detection of two different pressures at spaced posi- 
tions across the tablet 5 to generate automatically a 
linear vignette of colour varying between the colours 
defined by the two pressures. 



Claims 

1. Image processing apparatus comprising an Input 
device including an indicator (31) and a surface 
(5) over which the indicator is moved; position 
determining means for determining the position of 
the indicator on the surface; a force monitor (3) for 
monitoring the force with which the Indicator is 
pressed onto the surface; a frame store (22) for 
storing digital data defining the colour component 
content of an image; and processing means (3) 
connected to the input device and the frame store 
for simulating an electronic paint brush carrying 
paint which is laid down in the frame store at loca- 
tions corresponding to the positions of the indi- 
cator on the surface and whose characteristics 
are determined at least in part in accordance with 
the force monitored by the force monitor. 

2. Apparatus according to claim 1, wherein the 
characteristics are chosen from hue, brightness 
and saturation. 

3. Apparatus according to claim 2, wherein the pro- 
cessing means is adapted to maintain hue con- 
stant while modifying brightness and saturation in 
accordance with the monitored force. 

4. Apparatus according to any of the preceding 
claims, wherein the processing means applies to 
the monitored force value a colour selection func- 
tion for each colour component, the colour selec- 
tion function defining the variation in 
characteristic^) of the corresponding colour 
compon nt with monitored force. 

5. Apparatus according to claim 4, wherein the col- 
our selection fundi n is discontinuous and 
d fines colour component values for spaced 



groups of f rce values. 

6. Apparatus according to claim 4 or claim 5, whe- 
rein the image is defined by more than one colour 

5 component, the associated colour selection func- 

tions being different 

7. Apparatus according to any of the preceding 
claims, further comprising a display (30) connec- 

10 ted to the frame store (22) so as to display the 
image defined by digital data in the frame store. 
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(G) Image processing apparatus. 

(57) Image processing apparatus comprises an 
input device including an indicator (31) and a 
surface (5) over which the indicator is moved. A 
host (1) determines the position of the indicator 
(31) on the surface (5) and also the force by 
which the indicator is placed onto the surface. 
Frame stores (22) store digital data defining the 
colour component content of an image. The 
host (1) simulates an electronic paint brush 
carrying paint whose characteristics are deter- 
mined at least in part in accordance with the 
force of the indicator (31) on the surface (5). 
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